Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support pylayer for moe #70375

Merged
merged 3 commits into from
Dec 25, 2024
Merged

support pylayer for moe #70375

merged 3 commits into from
Dec 25, 2024

Conversation

xuxinyi389
Copy link
Contributor

@xuxinyi389 xuxinyi389 commented Dec 20, 2024

PR Category

Operator Mechanism

PR Types

New features

Description

card-73263
1.与 #70335 完整支持 pylayer的子block输入输出更新功能(手动调用)。
2.moe_global_mesh_tensor/moe_sub_mesh_tensor api 内部动静不统一分支下沉到 pylayer 内部,保证 pylayer的静半能力。
3.提供工具函数update_pylayer_output,用于更新pylayer op 的输出
Example:

            (1) Original pylayer operation:
                (%1, %2) = "pd_op.pylayer" (%0) {
                    () = "cf.tuple_pop" [id:1]
                    (%3, %4) = "dist_op.xxx" [id:2]
                    () = "cf.yield" [id:3] (%3, %4)
                }
            (2) After calling `update_pylayer_output(%4)`, the updated pylayer operation removes the unused output:
                (%1) = "pd_op.pylayer" (%0) {
                    () = "cf.tuple_pop" [id:1]
                    (%3) = "dist_op.xxx" [id:2]
                    () = "cf.yield" [id:3] (%3)
                }

Copy link

paddle-bot bot commented Dec 20, 2024

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link
Contributor

@From00 From00 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@From00 From00 merged commit f3efb3a into PaddlePaddle:develop Dec 25, 2024
28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants